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METHOD AND APPARATUS FOR CAPTURING DATA FROM A MEMORY 



SUBSYSTEM 

Field 

The invention pertains generally to memory devices, and 
more particularly to clock generation for data capture. 

Background 

Traditionally, memory controllers have relied on external 
clocks to be able to write data to or read data from a 
synchronous memory subsystem (e.g. memory storage devices). 
Providing these clocks between the memory controller and the 
memory subsystem typically involves the use of multiple pins 
on memory controller modules and memory subsystems . These 
pins and clock traces on controller modules and memory 
subsystems often consume much needed space on the memory 
subsystem's board, module, or interface. 

Figure 1 illustrates a conventional prior art memory 
controller 102 and memory subsystem 104 configuration. In 
computer implementations, the memory controller 102 is 
typically a component on the motherboard which manages 
communications to and from the memory subsystem 104. A memory 
subsystem 104 is typically a separate module (such as a dual 
in-line memory module (DIMM) or single in-line memory module 
(SIMM) ) which stores and provides data as directed by the 
memory controller. 

A typical memory controller-to-memory subsystem interface 
includes a bus with multiple command/ address lines, data 
lines, write clock lines, and/or read clock lines. The 
command/address lines allow the memory controller 102 to 
indicate to the memory subsystem 104 to store data or retrieve 
data. The data lines (either bi-directional or uni- 
directional) serve to transmit data between the memory 

controller 102 and the memory subsystem 104. 
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When the memory controller 102 stores or writes data to 
the memory subsystem 104, it provides the memory subsystem 104 
a clock (write clock) from which to synchronize and sample the 
data sent. That is, the memory subsystem 104 needs a clock 
5 from which to synchronize the data received over the data 

lines so that it may be correctly detected. Where multiple 
data lines are used, the memory controller typically provides 
one clock per one or more data lines. 

Similarly, the memory controller 102 needs to synchronize 
10 and sample data retrieved from the memory subsystem 104. 

Conventionally, the memory subsystem provides read clocks to 
the memory controller for this purpose. Typically, the memory 
controller 102 provides one clock per one or more data lines. 
Thus, when the number of data lines increase so do the number 
15 of corresponding clock lines, inputs, pins, and/or traces. 

Dynamic random access memory (DRAM) is a common type of 
memory storage device used in computers and other electronic 
devices. As described above, traditional synchronous DRAM 
(SDRAM) memory subsystems employ externally generated clocks 
20 to synchronize writing data to and reading to from a DRAM 

module. In the case of double data rate (DDR) DRAMs, 
additional strobe lines are employed to enable the rate 
doubling. For example, in DDR SDRAM systems, a system clock 
plus one strobe per four to eight data bus lines is typically 
25 employed to read data. On a sixty-four bit/line wide memory 

data bus this equates to eight to sixteen read clock signal 
pins on the controller, motherboard, and/or memory module 
connector. 

As the speed of memory subsystems and data transmission 
30 increase, the number of clocks and strobes needed to achieve 

reliable data transmission increases, adding to the cost and 
detracting from the feasibility of designing and implementing 
such subsystems . 
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BRIEF DESCRIPTION OF THE DRAWINGS 



Figure 1 is a block diagram illustrating one embodiment 
of a conventional interface between a memory controller module 
5 and a memory subsystem. 

Figure 2 is a signal diagram illustrating how a 
synchronous data signal is typically sampled by a clock. 

Figure 3 is a block diagram of a device configuration 
embodying one implementation of the internal clock generator 
10 aspect of the invention. 

Figure 4 is a block diagram illustrating one 
implementation of an internal clock generator within a memory 
controller coupled to a DRAM memory subsystem according to one 
embodiment of the invention. 
15 Figure 5 is a block diagram illustrating the two stages 

of the invention - a multi-clock generator followed by a clock 
CO interpolator. 

7" Figure 6 illustrates a block diagram of one embodiment of 

a multi -clock generator to generate multiple clocks from a 
q 20 reference clock according to one aspect of the invention. 

Figure 7 is a diagram illustrating the different clock 
fy phases that may be generated by a multi -clock generator 

according to one implementation of the invention. 

Figure 8 is a block diagram illustrating one embodiment 
25 of a delay cell which provides a phase shifted clock. 

Figures 9A and 9B are waveform diagrams illustrating how 
the multiple sampling clocks that may be generated by the 
clock generator of Fig. 6 serves to over- sample a calibration 
pattern. 

30 Figure 10 is a block diagram illustrating one embodiment 

of an interpolation and fine-tuning circuit which interpolates 
two sampling clocks to provide a single synthesized clock. 

Figure 11 is a waveform diagram illustrating how a 
synthesized clock is generated from two sampling clocks. 
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Figure 12 illustrates one method of practicing the 
internal clock source invention. 
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DETAILED DESCRIPTION 

In the following detailed description of the invention, 
numerous specific details are set forth in order to provide a 
5 thorough understanding of the invention. However, the 

invention may be practiced without these specific details. In 
other instances well known methods, procedures, and/or 
components have not been described in detail so as not to 
unnecessarily obscure aspects of the invention. 
10 In the following description, certain terminology is used 

to describe certain features of the invention. For instance, 
v frame' includes any block or arrangement of data or 
u information. The term ^data' includes voice, text, address 

O and/or control information, and/or any other type of 

ijj15 information. The term ^external clock' includes any clock 

transmitted by a data transmitting device to a data receiving 

p 

I33 device to permit the data receiving device to sample a data 

stream transmitted by the data transmitting device. The term 
Q > internal clock' includes clocks not transmitted by the data 

20 transmitting device, and clocks generated by the receiving 

M device. Additionally, memory subsystem refers to all types of 

t! memory storage devices including DRAM, SDRAM, and DDR DRAM. 

One aspect of the invention provides a system, device, 
and method to eliminate the need to provide external read 
25 clock (s) (synchronization clock) for a device to synchronize 

and sample incoming data signals. By providing an internal 
read clock, the invention decreases or reduces the number of 
pins/ inputs on the device and the number of clock lines 
employed at an interface. 
30 For purposes of illustration, various examples described 

herein employ a memory controller and memory subsystem 
configuration. However, it should be clearly understood that 
the scope of the invention is not limited to practicing the 
invention on memory controllers and memory subsystems. The 
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invention may be practiced in any electronic device which may 
benefit from the use of one or more internal clocks to 
synchronize one or more incoming data channels thereby 
avoiding the need for additional external clock pins or 
5 reducing pins/ lines on the device. 

For proper channel synchronization, a receiving device 
should be capable of accurately and reliably detecting/ reading 
each data unit or sample received. Figure 2 illustrates how a 
read clock (synchronization clock) is employed to sample two 
10 data units (A and B) . Accurate and reliable detection of data 

units is typically accomplished by sampling data away from 
the edges of the data unit. That is, the edges of a data unit 
may shift slightly from sample to sample, resulting in 
f»% erroneous readings if the data unit is sampled close to the 

*«J 15 edges. Thus, it is preferable to sample a data unit in the 

ri middle region of the data unit as shown in Fig. 2. Note that 

y data may be read, detected, or sampled on clock transitions. 

.Q For example, the read data stream may be sampled on both the 

rising and falling edges of the read clock signal. In other 
Ly 20 embodiments, a data stream may be sampled on either the rising 

; =:: f or falling edge only. 

Q Referring to Figure 3, a block diagram of a device 

n t 

! ' ; " configuration embodying one implementation of the internal 

clock generator aspect of the invention is shown. A memory 

25 controller 3 02 is communicatively coupled to a memory 

subsystem 3 04 to write data to and read data from the memory 
subsystem 304. According to one implementation, the memory 
controller may be part of a computer motherboard while the 
memory subsystem may be a separate component (such as a DIMM 

30 or SIMM) . One or more data lines, write clock lines, and 

command/address lines serve to transmit data and/or signals 
between the memory controller 3 02 and the memory subsystem 
304. An internal clock source 306 within the memory 
controller 3 02 generates one or more internal clocks which may 

35 be used as write clocks when transmitting data or internal 
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read clocks (synchronization clocks) when receiving data. As 
a result of the internal read clocks the need for external 
read clock lines from the memory subsystem 3 04 to the memory 
controller 3 02 is avoided. 
5 According to one aspect of the invention, the internal 

clock source 3 06 is used to 1) provide external clocks (write 
clocks) for source synchronous transmission of data written 
and commands/addresses sent to the memory subsystem 3 04 and 2) 
to provide a root clock to interpolator circuits that generate 
10 a number of internal clocks (read clocks/synchronization 

clocks) for the purpose of sampling data read from the memory 
subsystem 3 04. 

In one implementation, the internally generated clocks 
3 06 are of sufficient accuracy and phase alignment to be 
Q 15 useful in sampling the data received from the memory subsystem 

a 304 • 

O Figure 4 is a block diagram illustrating one 

p implementation of an internal clock source or generator 3 06 

JL (Fig. 3) within a memory controller 402 coupled to a DRAM 

UJ 20 memory subsystem 4 04 according to one embodiment of the 

^ invention. A clock generator or source 406, serves as a 

ri reference clock for the controller 402. This reference clock 

m 

: ' :;:r 406 goes to a phase locked loop circuit (pll) 408 that 

generates one or more clocks for synchronizing write data wclk 

25 (e.g. wclkO-wclkn) and command /address information (wclk_ca) 

transmitted to the DRAM subsystem 404. The wclk signal from 
the pll 40 8 also serves as input to one or more clock 
interpolator circuits 410 (e.g. interpolators 410A and 410B) . 
The interpolator circuits 410 generate or synthesize read 

30 clocks (rclkO-rclkn) for synchronizing received data / read 

data transmitted from the DRAM subsystem 404 to the memory 
controller 402. The number of interpolator circuits 410 is 
determined by the width of the data bus and accuracy needed to 
provide read clock edge placement within the received signal 

35 data units. Unlike the conventional read/synchronization 
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clocks which are typically generated by the transmitting 
device (e.g. memory subsystem 404), read clocks (rclkO-rclkn) 
are synthesized from a reference clock 40 6 independent from 
the transmitting device and without a dedicated synchronizing 
5 clock line between the receiving device and the transmitting 

device . 

According to one implementation, illustrated in Figure 5, 
each interpolator circuit 410 comprises a first subsystem 500, 
a multi-clock generator which generates one or more clocks of 
10 different phases, and a second subsystem 502, an interpolator 

which interpolates between two of the generated clocks clk_x 
and clk_y to generate a single synthesized clock, to 
accurately detect and synchronize a received data signal. 
JZ Figure 6 illustrates a block diagram of one embodiment of 

O 15 a multi-clock generator 500 which generates multiple clocks 

25 from a reference clock (ref elk) . In one implementation, the 

O multi-clock generator 500 provides a full three hundred sixty 

pj (360) degrees of possible phase shift for the read clocks. By 

^ providing a full three hundred sixty (360) degrees of possible 

hi 20 phase shift, full flexibility in read clock edge placement is 

achieved. 

fi According to one embodiment, multiple phase shifted 

= y clocks may be generated by chaining together programmable 

delay cells (51- 54) and sending clocks from both ends of the 

25 delay chain to a phase detector 604. Each delay cell (51- 54) 

generates a phase delayed clock (e.g. tl, t2, etc,) . For each 
clock generated (e.g. to, tl, etc.) a corresponding inverted 
clock (e.g. t0#, tl#, t2#, etc.), approximately one hundred 
eighty (180) degree delayed, is also provided as illustrated 

30 by Figure 7. Drivers 608A-E coupled to the delay cells (51- 

54) serve to receive a clock and provide both the clock (e.g. 
tO) and its inverted version (e.g. t0#) as outputs. The phase 
detector 604 detects the phase difference between its two 
input clocks (e.g. to and t4#) and provides an error signal to 

35 a controller 605. 
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In one embodiment, the phase detector 6 04 is a zero (0) 
degree phase detector. Thus, clocks tO and t4 are 
approximately one hundred eighty (180) degrees out of phase, 
such that to and t4# are in phase when the unit 50 0 is locked. 
The phase detector 604 sends adjustment information to a 
controller 605 to adjust the programmable delay cells until 
the clocks to and t4# are in phase. 

Based on the error signal from the phase detector 604, 
the controller 605 adjusts the phase shift for delay cells 
(51- 54) so that there is no substantial or significant 
difference between clocks to and t4# - they are in phase. In 
one implementation, the controller 605 digitally configures 
the phase shift angle of each delay cell (51- 54) . 

In one embodiment, once these adjustments are performed, 
the generated clocks are substantially equally spaced through 
three hundred and sixty (360) degrees as illustrated in Figure 
7. That is, clocks to, tl, t2, t3, and t4 are spaced from 
zero (0) to one hundred eighty (180) degrees from to . Thus, 
the inverted version of these clocks t0#, tl#, t2#, t3#, and 
t4# are one hundred eighty (180) to three hundred sixty (360) 
degrees out of phase with to. Hence, a full three hundred 
sixty (360) degrees of phase shift may be created by the 
multi-clock generator 500. 

The delay cells may be chained or configured in various 
ways to provide the multiple phase-shifted clocks (e.g. to, 
tl, t2, etc.). In one implementation, shown in Figure 6, the 
phase delayed clock generated by each delay cell (51- 54) also 
serves as an input to the next delay cell. For instance, the 
clock generated by 51 may serve as input to 52 , etc. 

Figure 8 illustrates one embodiment of a delay circuit 
802 which provides two phase shifted clocks 804 & 806 (clk_i & 
clk_i#) , one hundred eighty (180) degrees apart. According to 
the implementation shown, a pair of differential amplifiers 
808 & 810, each comprising two field effect transistors (FET) , 
receive two input clocks 812 & 814 (Dn and Dn#) one hundred 
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eighty (180) degrees shifted from each other, and produce two 
further delayed clocks (clk__i & clk_i#) also phase-shifted one 
hundred and eighty (180) degrees from each other. 

While the exemplary embodiment in Figure 8 has 
5 illustrated one way of providing a delay circuit for 

generating multiple clocks phase shifted from each other, the 
invention is not limited to such circuit or implementation. 
Rather, the invention may be practiced with any device, 
component, method, or system capable of providing one or more 
10 phase shifted clocks. 

Figure 9A illustrates an exemplary embodiment of the 
various waveforms that may be generated mult i- clock generator 
of Figure 6. A two-step initialization procedure of rough- 
tuning and then fine-tuning is employed to generate a desired 
O 15 clock. Ultimately, a single clock (e.g. a synchronization 

q clock) is synthesized which lies at the mid-region of the data 

Jrf samples to accurately detect said samples. 

Q First, from among the multiple clocks generated (e.g. 

!L s__clk0 through s__clk7) , two sampling clocks are selected to 

yj 20 accurately detect a known data pattern (initialization signal) 

r 5 :' transmitted from the DRAM subsystem 404. The multiple clocks 

Q (e.g. s_clk0 through s_clk7) serve to over-sample the received 

calibration data pattern. 

According to one implementation, in selecting the two 
25 sampling clocks, a first clock is selected to lie on one side 

of the data sample midpoint and a second clock is selected to 
lie on the other side of the data sample midpoint. This may 
be accomplished in a number of ways, including by using an 
edge detector. For example, each data sample (data unit) 
30 within the calibration pattern may be over- sampled by the 

multiple phase-shifted clocks (s_clk0 through s__clk7) . 
Adjacent data samples are then compared (by exclusive OR logic 
operations for instance) to determine where the data sample 
edge is located. Additionally, other means of edge detection 
35 may be employed without deviating from the invention. 
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Having located the edge locations, two sampling clocks, 
one on each side of the data sample midpoint, are then 
selected. In another embodiment, the two sampling clocks 
closest to each data sample edge and within the data sample 
5 (data unit) are selected. 

Figure 9B is a more detailed example of the waveforms and 
clocks shown in Figure 9A to illustrate the selection of the 
two sampling clocks. Each sampling clock (s_clkO - s_clk7) 
samples a data unit of the calibration data stream. By 

10 comparing the Low-to-High or High-to-Low transitions and the 

sample values (Low or High) the edges of the data unit may be 
determined. From this information, the two clocks which fall 
within the data unit (data sample) may be selected. 

According to one embodiment, the clocks within the data 

15 unit and closest to the transition edge may be selected. For 

example, in Fig. 9B, clocks s_clkl, s_clk2, s_clk3, and s__clk4 
fall within the data sample and, of these, clocks s_clkl and 
s__clk4 are closest to each edge. Thus, clocks s_clkl and 
s_clk4 would be selected for interpolation in the fine-tuning 

20 stage . 

In another embodiment, the two clocks closest to the 
midpoint of the data sample are selected rather than the two 
clocks closest to the edges. By selecting the two clocks 
closest to the midpoint of the data sample, greater accuracy 
25 may be obtained in the fine-tuning stage. For example, in 

Figure 9B, clocks s_clk2 and s_clk3 would be selected since 
they are closest to the midpoint of the calibration data unit 
(data sample) . 

Other methods of clock selection may be employed without 
30 deviating from the invention. 

The selection of the two sampling clocks provides a 
coarse timing alignment for the data center (midpoint) . Once 
the two sampling clocks are selected, a single fine-tuned 
sampling clock may be generated. Fine-tuning encompasses 
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generating a clock capable of reliably sampling the data 
sample (s) . 

A single fine-tuned sampling clock may be synthesized by 
interpolating between the two selected clocks. 
5 Figure 10 illustrates a block diagram of an exemplary 

embodiment of a fine-tuning circuit 502 according to one 
embodiment of the invention. The fine-tuning circuit 502 
employs the two clocks (e.g. s_clk2 and s_clk3) selected in 
the rough- tuning stage (shown as clk_x and clk__y) to generate 
10 a single clock (synth_clk) which samples a calibration data 

pattern (initialization signal) substantially at its mid- 
region. 

A pre -determined calibration data pattern, e.g. 
p '10101010', is again sent from the DRAM subsystem. Other 

15 calibration patterns of different lengths and/or sequence may 

O be used without deviating from the invention. The purpose of 

J;;; the pre -determined calibration sequence is to provide a 

O reference by which the fine-tuning circuit can center its 

P=j clock edge on transmitted data samples. The calibration 

UJ 20 pattern may be provided in response to a request or command by 

£7 the interpolator circuit. 

Q According to one embodiment, sampling clocks clk_x and 

clk_y may be combined to provide a synthesized clock 
synth_clk. Sampling clocks clk_x and clk_y are combined 

25 through the weighing of the tail currents, I_l and I__2 . For 

example, a fifty percent (50%) synth_clk, which is midway from 
clk_x and clk_y, may be created by setting the same amount of 
current in I__l and I_2 . Thus, the phase delay of the 
synth__clk may be adjusted as desired by controlling the tail 

30 currents I_l and I_2 . 

According to one implementation, a ninety (90) degree 
phase detector 1002 compares the synthesized clock synth_clk 
and the calibration data pattern and provides an error signal 
to bring the synth__clk into approximately a ninety (90) degree 

35 phase shift with the calibration data stream/pattern. Any 
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conventional device to accomplish such ninety (90) degree 
phase comparison may be employed without departing from the 
invention. 

In one embodiment of the phase detector 1002, a phase 
5 comparison between the synth_clk and calibration data pattern 

is accomplished by comparing the amount of time the synth__clk 
and a calibration data pattern data unit overlap. Referring 
to Figure 11, the logic High portion of the synthesized clock 
is combined with the logic High portion of the calibration 
10 data unit. During this time of overlapping, the detector 

charges up a capacitor. Once the calibration data returns to 
logic Low, while the synthesized clock remains at logic High, 
the detector discharges the capacitor. When these two 
O waveforms are at ninety (90) degree, there is no net charge 

% 15 stored in the capacitor. That is, the charge in the capacitor 

Q over one cycle remains substantially the same. 

J55 Based on such phase difference information, the phase 

Q detector 1002 generates an error signal corresponding to the 

ft error /dif f erence between the synth_clk and the calibration 

20 data pattern. If the synth_clk and calibration data pattern 

|Zl are not ninety (90) degrees out of phase, the detector 1002 

y generates an error signal indicating the magnitude and 

direction in which the synth_clk phase should be shifted to be 
ninety (90) degrees out of phase with the calibration data 
25 pattern. 

Note that in another embodiment, sampling clocks clk__x# 
and clk_y# may also combined to provide an inverted 
synthesized clock synth_clk#. In such embodiment, both 
synth_clk and synth_clk# may be differentially compared with 
30 the calibration data pattern for greater accuracy. 

A control logic 1004 varies the current source I__l and 
I_2 to each regulating system, via feedbacks crtl_l and 
crtl_2, such that, while the current stays substantially 
constant (I__l + I__2 = constant) , clocks clk_x and clk_y are 
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shifted in the direction and magnitude indicated by the phase 
detector 1002. 

In this manner, the interpolated clock (synth_clk) moves 
towards the mid-point of the received data units causing the 
5 data to be sampled or detected substantially in the mid-region 

of each received data sample. 

Figure 11 illustrates the operation of the fine-tuning 
circuit 502 in Figure 10 to obtain a synthesized clock. The 
synthesized clock (synth_clk) represents the interpolated 
10 clock at the optimal sampling point, which is the ninety (90) 

degree detector lock point. Once the lock point is reached, 
the setting may be registered digitally. 

According to one embodiment, the controller 1004 
periodically performs the calibration procedure described 
^ 15 above to avoid internal clock drift. In one embodiment, the 

calibration procedure may only involve the fine-tuning stage. 

According to one embodiment, the first and/or second 
stage calibration signals/patterns are generated by the memory 
controller 402 sending a calibration command to the DRAM 
20 subsystem 404. In response to such calibration command, the 

memory subsystem 404 generates and sends the calibration data 
pattern to the memory controller 402. 

In one implementation, the calibration pattern is 
transmitted over the data lines between the DRAM memory 
25 subsystem 404 and the memory controller 402. However, this 

has the disadvantage of slowing memory accesses while the 
clocks are calibrated. This may be the case for example where 
clocks are periodically calibrated to correct for clock drift. 
In various embodiments, a processor may be employed to 
30 control the one or more components shown in Figure 11. That 

is, the processor may generate instructions or signals to 
control the operation of the ninety (90) degree phase detector 
1002, the controller 1004, and other components. The 
processor may also function as the phase detector 1002 and or 
35 controller 1004. A processor includes any general purpose 
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processor, application specific integrated circuit (ASIC) , 
digital signal processor (DSP) , microprocessor, 
microcontroller, and any device that processes data* 

In one embodiment, shown in Figure 12, the internal clock 
source may be provided by first generating multiple clocks 
with different phase angles as described 1202. Two clocks are 
selected, with one clock located on each side of the mid-point 
of a sampled calibration data unit 1204. Adjustable 
interpolation is performed between these two clocks to 
generate a single sampling clock (e.g. synchronization clock) 
120 6 with an edge located substantially at the mid-point of 
the calibration data unit sampled. 

Determining that a clock needs to be recalibrated or re- 
centered may be performed by any number of devices known in 
the art which detect when clock drift has occurred. In one 
implementation, the clock is automatically recalibrated after 
a specific amount of time. 

While certain exemplary embodiments have been described 
and shown in the accompanying drawings, it is to be understood 
that such embodiments are merely illustrative of and not 
restrictive on the broad invention, and that this invention 
not be limited to the specific constructions and arrangements 
shown and described. Additionally, it is possible to 
implement the invention or some of its features in hardware, 
programmable devices, firmware, software or a combination 
thereof. The invention or parts of the invention may also be 
embodied in a processor readable storage medium or machine- 
readable medium such as a magnetic, optical, or semiconductor 
storage medium. 
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